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ABSTRACT 

This study vas conducted to determine if student 
evaluations of faculjty are affected by the characteristics of the 
teacher, the student* and the class. Each instructor was asked to 
answer questions indicating personal irarmth, professorial rank, years 
of teaching experience, sex, and class size« students were asked to. 
complete the Instructional Improvement Questionnaire (IIQ).# The 
twenty questions on the HQ that directly evaluate instructor 
performance were analyzed^ Only the results for the first set of 
canonical functions are presented. An instructor who received high 
scores on this canonical function would be rated as encouraging 
student participation in the course, showiflg an interest iH stu^effts, 
!cnowing when students understood her/him, available to students, 
increasing appreciation for the course, and accepting criticism and 
suggestions^ The classes that received high values on this function 
were small in size, were taught by instructors who rated themselves 
as warm, and had students that expected high grades, (Author) 
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Effect of Teacher^ Student^ and Class 
Characteristics on the Evaluation of College Instructors 

The purpose of the present study was to Investigate the effect 
of teacher^ student^ and class characteristics on student evaluations 
of teaching effectiveness. 

Instructor characteristics such as sex» academic rank» teaching 
experience^ and warmth have been studied to determine their effect 
on student ratings of teaching effectiveness. Although Spencer (Note 1) 
concluded that there was no meaningful relationship between teacher 
sex and most Illinois Course Evaluation Questionnaire Iterns^ Sownle 
(1952) reported that women faculty compared to men faculty received 
significantly higher ratings for the extent to which they brought new 
books and^ authors into the classrooSr E35ore and"!^^ 
that women faculty received significantly higher ratings for "Promptly 
returned homework and tests'* while men faculty received significantly 
higher ratings on *'Spoke understandably." 

Three studies (Aleamonl & Graham* 1974; Aleamonl & Ylmer» 1973; 
Scott^ Note 2) found no relationship between student ratings and 
Instructor rank while Vlllano (Note 3) found that associate and full 
professors received higher ratings than instructors and assistant 
professors . 

Although faculty sex and rank aeem to have some Influence on student 
ratings of teacher effectiveness^ teacher personality characterlstlca 
such as warmth seem to have more Impact. Two investigations found 



2 

small to moderate correlations between warmth and student ratings of 
teaching effectiveness (Baird» 1973; Isaacson^ HcKeachie» & Hllholland» 
1963). Murray (Note 4) found that warmth correlated .56 with student 
ratings of teaching effectiveness. Sindlar findings reported by Costin 
and Crush (1973) were: The personality trait of personal relations 
correlated .60 with students* ratings of teacher skill* .55 with student 
involvement* .59 with teacher support* and -.59 with. negative affect 
in the class. Consistent with these results* Elmore and LaPointe (1975) 
found that teacher warmth was en important variable influencing student 
ratings and that self*ratings of warmth interact with faculty sex. 
Studies by McKeachie^ Lin and Mann (1971) and McKeachie and Lin (1971) 
also provide evidence that teacher warmth Is an important variable in 
teaching effectiveness and that warmth may interact with student sex. 

Results from studies examining the effect of student characteristics 
are as conflicting as the studies related to teacher characteristics. 
Two studies (Goodhartz* 1946; Isaacson et al.^ 1964) found no differences 
between faculty ratings made by male and female students. Bendig (1952) 
found that women students rated their Instructors (men) significantly 
lower than the male students rated them* Elliott (1950) found that 
women students tended to give higher ratings in **Presentation of the 
subject matter" than male students^ and Elmore and LaPointe (1974» 1975) 
found that female students rated instructors higher in "Specified 
objectives of the course." 

The relationship between student ratings of instructors and expected 
grade in the course was fotmd to be nonexistent in a study by Kennedy 
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(1975) and positive in three research reports (Fohlmanii^ 1975; Centra & 
Linn» Note 5; Christensen & Bourgeois^ Note 6). The grade point average 
and year in school variables have yielded similar conflicting results* 
Christensen and Bourgeois (Note 6) reported that students whose self- 
reported grades were either belovf 2.0 or above 3.5 on a 4 point system 
rated instructors higher than those \diiose grade point averages were 
between these two extremes and that seniors were most critical of their 
instructors. Frey» Leonard^ and Beatty (1975) found that the students' 
grade point averages did not systematically vary with their ratings; 
however^ more senior students rated instructors more favorably than their 
less experienced classmates. Centra and Linn (Note 5) reported that 
lowerclassmen (versus up per classmen) and students with higher expected 
grades and high cumulative grade point averages tended to rate the 
examinations^ course quality, and the text higher. Lunney (Note 7) 
reported that freshmen tended to rate instructors lowest while juniors 
and seniors .rate them highest. 

Only one study (Christensen & Bourgeois^ Note 6) included the amount 
of time per week spent on the course in the analysis of student character-^ 
istics. Their results revealed a linear trend toward more favorable 
evaluations as one spends more time on the course outside of class. 

Only two class characteristics variables^ the class size and the 
required-elective status of the course^ were included in the present 
study. Class size was found to have no relationship to student ratings 
by Aleamoni and Graham (1974) and Lunney (Note 7)» a slight negative 
relationship with student ratings by Scott (Note 2)» and a positive 
relationship with student ratings by Villano (Note 3). Gage (1961) » 
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Lovell and Haner (1955) » and Fohlmann (1975) found that teachers of 
elective courses. received higher ratings than teachers of required 
courses . 

This study differs from previous studies in that four types of 
variables were analysed simultaneously: Teacher-student-class character- 
istics and student ratings of instructors. 

Method 

The data for this study were obtained in conjunction with the 
university-wlde student evaluation of instruction program during the 
1973 -74 academic year. The Southern Illinois University at Carbondale 
(SIU-C) standard rating form is the Instructional Improvement Question- 
naire (HQ) (Elmore & Fohlmann» 1975). The HQ is designed to collect 
data on (a) student and class characteristics^ (b) student evaluations 

- -of' Instructors-and Xc). .student..evaluations of. coursjBA* In add i tion to 

the IIQ» information for this study was obtained using a brief faculty 
information form. 

The four types of variables analyzed in this study were: (a) teacher 
characteristics variables^ (b) student characteristics variables^ 
(c) class characteristics variables^ and (d) student ratings of instructors. 
The instructor rating items from the HQ used in this study appear in 
Table 1. The student and class characteristics variables used were; 

1. Level: Level of course (l^freshman» 2=sophomore» etc.) 

2. GPA; Mean grade point average of students enrolled in the 
course 

3. Outside Study Hours: Mean number of hours per week reported 
in study activity related to the course 
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4. General Bating: The average rating of the general quality of 
instruction at Southern Illinois University at Carbondale 

5t Expected Grade: The average grade expected hy students in the 
class 

6* Year in School: The average year in school of students in the 
class 

7. Sex: The percent of students in the class that were female 

8. Elective: The percent of students in the class taking the 
course as an elective 

9t Size: Nutnber of students enrolled in the course 
A brief faculty information form was used to obtain the teacher 
characteristics variables analyzed in this study. They were: 

1. Sex (0=Hitale» l^female) 

2. Bank (l«lecturer» 2»insti:uctor» S'^^assistant professor^ 
4=^associate professor^ and 5^rofessor5 — ■ - — 

3. Years of teaching experience (l=>one year or less» Z'^two to 
five years^ 3=slx to ten years^ 4=eleven to fifteen years^ 
and S^slxteen years or more) 

4. Self-rating of personal warmth (l=^ery» 2«above average^ 
3=moderatel7» 4=someiAat» and 5^ot at all) 

5. Self-rating of primary teaching interest (l«the student^ 
O^^course content) 

The sample of classes used in this study included courses at all 
levels^ from all colleges within the University^ taught hy Instructors 
at each of the teaching ranks» with a range of class sizes from small 
(less than 10 students) to large (more than 100 students). 
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Resulta 

The unit of analysis for this study was the class. The student 
ratings of instruction consisted of mean item responses. The student 
biographic data and the faculty information data were stimmarized for 
each class as described in the Method section of this paper. The niimber 
of classes used in the analysis was 174. 

The analysis of the data is presented in two parts. Table 1 
contains the correlations between the mean ratings on the 20 HQ 
Instructor evaluation items and the teacher-^student-class characteristics 
variables. Table 2 contains the result? of a canonical correlation 
analysis which related the teacher-student**class characteristics variables 
to the 20 HQ rating items. 

Canonical analysis was selected for this study because of its 
appropriateness in settings where the researcher wishes to examine 
the relationship between two sets of variables. Canonical analysis 
approches this analysis problem by solving for two sets of weighting 
coefficients* which when applied to each set of variables will form 
composite variables that maximally correlate. Canonical analysis can 
solve for multiple orthogonal sets of weighting coefficients* each set 
indicative of an independent pattern of relationships between the variable 
sets. The computer program used to conduct the analysis was program 
CANONA by Veldman (1967). 

The intercorrelation results presented in Table 1 indicated that 

Insert Table 1 about here 

the te ache r*^student-cl ass characteristics variables do not correlate highly 
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With student ratings of instruction. The great majority of the correlations I 

j 

are low and not significantly different from 0 (a .01). This indicates 
that a rather large portion of the variance in student evaluations of 
instructors is attributable to sources other than those examined in this 
study. 

Since the Pearson correlation is not sensitive to curvilinear 
relationships between variables, a number of one-way analyses of variance 
were calculated to determine eta square values. The eta square statistics, 
vhich assess the maximum degree of non-linear relationship, were compared 
to the r^ values derived from Table 1. This analysis indicated that the 
relationships reported in this analysis could be reported assuming linearity 
with no loss of meaning or changes in the interpretation. 

Even given the generally small magnitude of the correlations in 
Table 1, a pattern of relationships emerged. The most potent student 
characteristics variable was the grade expected by students in a class, 
suggesting that the grading leniency of the Instructor is a potent factor 
in student evaluations. The general rating of instruction at SlU-C 
was the next most important variable in terms of its relationship to 
student ratings. This finding hints at the presence of a rating leniency 
factor in student ratings, since all students in all classes were rsting 
the same Institution, SlU-C. 

The items from the HQ also varied in their relations to the teacher** 
student-class characteristics variables examined. Items reflecting a 
stndent orientation factor (items 16 and 19) tended to correlate highest 
with the teacher-student*-class characteristics variables. 
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The results of the canonical analysis appear in Table 2. Only the 
results for the first set of canonical functions is presented^ because 



Insert Table 2 about here 

it was the only set that had a redundancy coefficient (Stewart & Love, 
1968) associated with the student rating item battery that was greater 
than .10. The redundancy coefficient measures the proportion of 
variance in a battery of variabiles explained by the canonical function. 
In this respect^ the redundancy coefficient is analogous to the percent 
of trace statistic traditionally reported in factor analytic studies. 

The largest canonical correlation^ the one reported in table 2, 
was .83, and was significantly greater than zero (a ^ .01) . The figures 
presented in Table 2 are the correlations^ or loadings, of the original 
-- .variables. ,wi-th.^the_.canpnieal loadings amplified the 

relationships that vere cursorily noted earlier by inspection of the 
R matrix in Table 1. 

The loadings associated with the rating variables indicated that the 
rating items that were most predictable from the teacher-student^^class 
characteristics variables vere those which reflected the degree of teacher*^ 
student interaction. An instiructor obtaining high scores on this canonical 
function would be rated as encouraging student participation in the 
course, showing an interest in students, knowing when students understood 
her/him, available to students, increasing appreciation for the course, 
and accepting criticism and suggestions. 

The loading associated with the tea cher-student-*c lass characteristics 
variables indicated that the most potent student variable was the loean 
expected grade for the class. Other variables which received high loadings 
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on this canonical function were class size and instructor warmth. Hence 
the classes receiving high values on this function were small in size» 
vere taught by instructors who rated themselves as warm^ and had students 
that expected high grades. 

Discussion 

Three teacher-student-class characteristics variables were found 
to be Important factors in student ratings of teacher effectiveness. 
They were; 

1. Expected Grade in the Course. The findings of the present 
study were consistent with results reported by Pohlmann (1975) » Centra 
and Linn (tlote 5)» and Christensen and Bourgeois (Note 6) indicating a 
positive relationship between student ratings of instructors and expected 
grade in the course. 

2; Class Size. Squall classes received higher ratings .than, large 
classes in this study as well as in the investigation by Scott (Note 2) . 

3. Teacher Warmth. Consistent with previous findings (Elmore & 
LaFointe, 1975; Baird» 1973; Costin & Grush» 1973; Isaacson^ McKeachie^ & 
Milholland^ 1963; Murray^ Note 4)i teacher warmth was an important 
variable influencing student ratings of teacher effectiveness. 

The HQ items that were most predictable from the teach er^student 
characteristics variables were (a) ^'Encouraged student partlcipationi 
Cb) *'Shoi^d an interest in students^" (c) **Knetf if students understood 
her/hlm»" (d) "Was available outside of class^" (e) "increased your 
appreciation for the subject" and (f ) "Accepted criticism and suggestions." 
These items measure the degree of teacher-student interaction or the 
degree of student orientation exhibited by an instructor. 
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In general^ it was found that warm instructors teaching small classes 
ulth students that expected high grades received higher teacher effectiveness 
ratings on item measuring the degree of the instructor's orientation 
toward students than on items measuring other aspects of teaching effective*- 
ness such as course difficulty and presentation of material. These results 
seem to offer some information concerning the discriminant validity of 
student ratings of teacher effectiveness* 

Rirther research is needed to determine the variables that affect 
student ratings of college instiructors . the teacher-student -class 
characteristics variables included in this study do not correlate highly 
with student ratings; therefore^ a large portion of the variance in 
student evaluations of college instiructors is attributable to sources 
other than those examined in this study. 
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Table 1 



Correlations Between Student Ratings ^ 
and teacher-Student-Class Characteristics Variables 

(K=174 courses) 



Item Statements 

1 Prepared for class 

2 Made clear assignments 

3 Set clear standards for grading 

4 Graded fairly 

5 Knew if students understood her/him 

6 Spoke understandably 

7 Answered impromptu questions satisfactorily 

8 Showed an interest in the course 

9 Gave several examples to explain complex ideas 
10 Accepted criticism and suggestions 

XI Increased your appreciation for the subject 

12 Was dependable in holding class as scheduled 

13 Specified objectives of the course 

14 Achieved the specified objectives of the course 

15 Promptly returned homework and tests 

16 Showed an interest in students 

17 Knew his subject matter 

18 Was available outside of class 
X9 Encouraged student participation 

20 In general^ taught the class effectively 



K o te# Decimal points have been omitted to conserve space* 
^V»f*nnale» 0°male 

> jdent» O*content 
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Table 2 

Loadings of Original Variables on the 
First Pair of Canonical Variables 



Canonical Correlation Coefficient .83 

HQ Items Teacher*-Student^las& 
(see Table 1 for their description) Characteristics Variables 

Item 



Ibnober 


Loading 


Variable 


Loading 


1 




Course Level 


.39 


2 


.19 


Mean Class CPA 
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3 
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(l*lec"turery . . . 
5«=professor) "^'^^ 
Sex of Instructor 

(Q >male^ 1-f emale } . 21 
Instructor's Sel£ Rating 
of Interest 
(0<^ontent of course » 
Intstudents) .43 



Redundancy Coefficient » .14 



Redundancy Coefficient .11 
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